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ABSTRACT 

This document was developed to provide principal 
investigators and project evaluators working with the National 
Science Foundation's Directorate for Education and Human Resource 
Development (EHR) with a basic understanding of dissemination. It 
aimed at people who want to learn more about both developing and 
implementing a dissemination plan. It complements the "User-Friendly 
Handbook for Project Evaluation, Science, Mathematics, Engineering, 
and Technology Education." Dissemination guidelines are included. 
(Author /ZWH) 
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The Foundation provides awards for research in the sciences and 
engineering. The awardee is wholly responsible for the conduct of such 
research and preparation of the results for publication. The Foundation, 
therefore, does not assume responsibility for the research findings or their 
interpretation. 

The Foundation welcomes proposals from all qualified scientists and 
engineers, and strongly encourages women, minorities, and persons with 
disabilities to compete fully In any of the research and related programs 
described here. 

In accordance with federal statutes, regulations, and NSF policies, no 
person on grounds of race, color, age. sex, national origin, or disability 
shall be excluded from participation in, denied the benefits of, or be 
subject to discrimination under any program or activity receiving finan- 
cial assistance from the National Science Foundation, 

Facilitation Awards for Scientists and Engineers with Disabilities 
(FASED) provide funding for special assistance or equipment to enable 
persons with disabilities (investigators and other staiT, including student 
research assistants) to work on an NSF project. See the program 
announcement or contact the program coordinator at (703) 306-1633. 



Privacy Act and Public Burden 

Information requested on NSF application materials is solicited under the 
authority of the National Science Foundation Act of 1950, as amended. 
It will be used in connection with the selection of qualified proposals and 
may be used and disclosed to qualified reviewers and staiT assistants as 
part of the review process and to other government agencies. See Systems 
of Records, NSF-50. "Principal Investigator/Proposal File and Associated 
Records. • and NSF-5 1 . "Reviewer/Proposals File and Associated Records. " 
56 Federal Register54907 (Oct. 23, 1991). Submission of the InformaUon 
is voluntary. Failure to provide full and complete information, however, 
may reduce the possibility of your receiving an award. 

The public reporting burden for this collection of information is estimated 
to average 120 hours per response, including the time for reviewing 
Instructions. Send comments regarding this burden estimate or any 
other aspect of this collection of information, including suggestions for 
reducing this burden, to Herman G. Fleming, Reports Clearance OITlcer. 
Division of CPO, NSF, Arlington, VA. 20330; and the Ofiice of Manage- 
ment and Budget. Paperwork ReducUon Project (3145-0058), Wash., 
D.C. 20503. 

The National Science Foundation has TTD (Telephonic Device for the 
Deal) capability, which enables Individuals with hearing impairment to 
communicate with the Foundation about NSF programs, employment, or 
general infonmaUon. This number is (703) 306-0090. 
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PREFACE 



PREFACE 



Tills document was developed to provide Principal 
Investigators £ind Project Evaluators working with the 
National Science Foundation's Directorate for Educa- 
tion and Human Resource Development (EHI^ with a 
basic understanding of dissemination. It is aimed at 
people who want to learn more about both developing 
and implementing a dissemination plan. It comple- 
ments the **User-Frlendly Handbook for Project Evalu- 
ation, Science, Mathematics, Engineering, and 
Technology Eklucatlon" which is also available from 
NSF. 
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DISSEMINATION GUIDEUNES 



The National Science Foundation strongly believes in 
the importance of disseminating the findings of suc- 
cessful projects. The purpose of this document is to 
provide guidelines for NSF grantees in thinking about, 
and planning for. the dissemination and implementa- 
tion of project results. 

What 1$ Dissemination? 

"... to scatter widely, as in sowing seed. , . to spread 
abroad. . are Webster's definitions. Most people 
would say that dissemination is the process of getting 
information and products to potential users. Unfortu- 
nately, thatxlewls not sufficient. Without working on 
the reception side, you may have a message that 
virtually no one listens to. much less acts on. 

For a long time, researchers in the social sciences 
aligned themselves with engineers. The idea was 
that a rational research and development process 
(Research — >Development — >Dissemination) 
would be sufficient to do the job. As it turned out. 
what is needed in the social and behavioral sci- 
ences is a more complex and less linear model for 
transferring knowledge from developers and re- 
searchers to users. Here is a definition that more 
accurately reflects the complexity of the process: 

Dissemination is the process of communi- 
cating information to specific audiences 
for the purpose of extending knowledge 
and, in some cases, with a view to 
modifying policies and practices. 

Within the definition are concepts dealing with four 
different goals of dissemination: spread of informa- 
tion, choice of alternative products or procedures, 
exchange of information, and implementation of 
new processes or procedures (Klein. 1992). Let us 
explore these four goals. 

When spread is the focus of the dissemination effort, 
avariety of media formats are usually considered, e.g.. 
audio, video, or text, using one or more vehicles: 
presentation at professional meetings, publications in 
journals and telecommunications. Spread is usually 
aimed at a large number of people and reaches them 
at random. A targeted spread would define audiences 
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Placement of information in a 
datalxfse is no guarantee of 
eventual dissemination; it occurs 
only wt)en someone knows enough 
to request it. 



more narrowly and confine communication to those 
journals read by the specific audience; to those confer- 
ences attended by the defined audience; and to tele- 
communications networks that are likely to include 
members of the target group. 

Dissemination as choice involves the communica- 
tion of information about alternative products, 
practices, programs, and policies. It is delivered by 
libraries, information centers and clearinghouses. 
Its function is to help users to locate needed 
information that is not usually available at their 
fingertips. With easier access to databases online 
and toll-free telephone numbers, information can 
be obtained so that choice of relevant data can be 
made. However, for successful dissemination, the 
information must be put into the system and users 
must become aware of its availability. Placement of 
information into a database is no guarantee of 
eventual dissemination; it occurs only when some- 
one knows enough to request it. 

Exchange occurs when information, products or obser- 
vations are shared. Examples of exchange involve inter- 
active communication through face-to-face visits, 
e-mail messages, and informal conversations at pro- 
fessional meetings. The "audience" is usually smaller- 
individuals or small groups who sometimes form 
networks for the purpose of sharing research findings, 
new information, and availability of materials. 

Implementation is the actual use of information by 
other practitioners and is fostered by direct assistance 
to the user. It may include training in the use of a new 
product or procedure through a local team trained by 
the original developer; it may be a "help*' screen on a 
computer or a toll-free telephone number that facili- 
tates implementation. Implementation is actually one 
of the major purposes of dissemination. It is often 
assumed to occur simply because information has 
been sent, Crandall (1989) concludes: 

"Policies that involve clearly defined and 
validated practices, when linked with in- 

person assistance from experienced de- 
velopers, implementors, and facilitators. 

appear to have a greater chance for im- 
proving school practice/' 



Dissemination is context dependent. People in vari- 
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WHAT IS A DISSEMINATION PLAN? 



ous settings often act on the basis of traditions and 
values of the organization. There are general proce- 
dures or guidelines that are useful but absolute 
rules do not exist. 

What Is a Dissemination Plan? 

Like any organized procedure to accomplish spe- 
cific results, a dissemination plan is deceptively 
simple. At first it may seem like a list of activities 
that have been organized to communicate a mes- 
sage to people who want (or ought) to receive it. 
However, a broader definition of dissemination is 
employed here. Greater complexity emerges and 
the need for a specific plan is evident. Before 
actually writing a plan, think about the following 
questions: 

Why? What is the purpose of the dissemination 

effort? What should happen as a result? What 
difference should it make? Why bothv 

Who? Who are the ultimate users of the product or 

practice? Should the users be reached directly 
or through intermediaries? How many people 
are In the audience and where are they 
located? Is there a secondary audience? 

What? What is the content that is to be 

disseminated? Is it new knowledge? What 
form is it in? If it is a product, does it require 
any type of training or assistance to ensure its 
proper use? 

How? What means or media could be used to 
disseminate the knowledge or products? 
Should several media be used? What are the 
most cost-effective ways to reach the defined 
audience? Are prospective users more likely to 
seek information from one source than 
another? 

With What Consequences? What does one expect to see if the dissemination 

is a success? Where will it make a difference? 
Are we fostering awareness? adoption? greater 
knowledge? enlightenment? enhanced capacity? 
changes in ongoing policies and practices? 
Without knowing which level of outcome we are 
after, it is practically impossible to make a 
dissemination plan. 
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Getting Started 



TTiere Is no universal formula for successful dissemi- 
nation. Still, if you can answer the why? who? what? 
etc. questions above, you will be at least halRvay there. 
Beyond that, there are only a few "rules of thumb." 

• Words on paper alone won't get far. If you v^^ant 
potential users to really understand and use your 
product or innovative practice, you will need to 
interact with people. 

• Work as much as possible through existing 
channels, networks, and associations. They will 
carry ycur messages to the people who are likely 
users. 

• Begin planning for dissemination early in the 
project; this allows you to prepare the ground. 
Waiting until the end often means that your 
public is going to face a steeper learning curve 
than you did. 

• Try to stay with your dissemination long enough 
to measure its actual impact and assure quality 
control. 

Building ttie Plan: Decisions 



A dissemination plan usually involves five major 
decisionc: (l) defining the purpose; (2) IdenUfying the 
audience; (3) stating content; (4) designing strategies; 
and (5) assessing impact. Each step will be discussed 
in the following sections. It is sometimes necessary to 
return to earlier steps during the process. 

Decision Point — Defining tt)e purpose 

One of the first decisions is to determine the desired 
purposes. A linear continuum helps to review the 
options in terms of goals to be reached. As one moves 
along the continuum, increasing efl'ort is required to 
achieve the goal. 

Some NSF dissemination initiatives stop at the 
level of awareness or understanding. This level 
might be acceptable for some projects but, if prac- 
tices or products are to be adopted and imple- 
mented, further steps have to be taken. These 
additional steps require more time and, usually. 



A good nile oftliumb is to 
assign a 3-5% of tlie project 

budget to dissemination 
and allow about Id rr)ontt)S 
for ttiis phase of ttie project. 




10 



EHR/NSF Dissemination Handbook 



USER'FRieNDLY HANDBOOK FOR PROJECT DISSEMINATION 



BUILDING THE PLAN: DECISIONS 




more funds. The question for Decision Point #1 
really Involves two considerations: the desired level 
of dissemination and the available resources. 



Decision Point #2 — identifying ttie audience 

The next decision involves specification of the audi- 
ence to be reached. Sometimes there may be primary 
and secondary audiences. Think in tenms of specific 
people and what they already know prior to exposure 
to this new information. Also consider the number of 
people who should be reached. The names may not 
necessarily be stated but can be translated into such 
descriptors as **departmentchair,"**princlpal/'or"presi- 
dent of the teacher's union." 



lnn0V0tor$ ^ \h<m f«w with sp^clol iniemU 
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It may be helpful to look at the first two decision 
points using a matrix that focuses on those ele- 
ments as shown in Exhibit 1. 



To use the matrix, name the persons who will be 
Involved and determine the category into which they 
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Exhibit) 



A Matrix to Assist in Developing a Dissemination Strategy 


Level 


Audience 




Innovators 
rQnAclal 
interest) 


Key Persons 

V w vj » t? IS t? o jj t? 1 0 y 


Potential 
Aaopiers 


Everyone 

vviivj iviiyiu 

Be Affected 


Awareness 










Understanding 










Acceptance 










Adoption 










Implementation 










Institutionalization 











fall. Next, indicate the level you want each person to 
reach. If the Principal Investigator wants the univer- 
sity professor of computer science to be aware, an **x** 
would be placed in the "special interest" column 
opposite "awareness." For another purpose, say the 
"adoption" of the ideas by the "chair of Uie computer 
science department," an "x" would be placed at that 
intersection and a dissemination plan would be devel- 
oped with that focu 5 in mind. 

Decision Point #3 — Stating Content 

Content is broadly defined. It may be the research or 
evaluation findings of a project; a product (such as a 
computer program, a series of videodisks or a syllabus 
for a course); a process or procedure combining 
several of the above. Content is substance. It can be 
described. It is the essence of what the audience 
should receive. Once decided, the level of understand- 
ing should be determined. 

The "stufT* of disseminatior. is the content. Content is 
found in products, practices, programs, and policies. 
"Products" are usually independent, self-standing 
instructional materials, such as computer software, 
laboratory kits, videotapes, audiotapes, and text- 
books. "Practices" are teaching methods, usually com- 
bined vvlth instructional managementprocedures that 
are used in teaching/learning environments. They are 
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DESIGNING STRATEGIES 



sometimes called "techniques.** Content could also be 
process — the practice of presenting and interacting 
with substantive information. It could be "knowledge** 
created from project findings; it could be a synthesis of 
separate existing knowledge that yields new under- 
standing when analyzed as a whole. 

Content ought to be one of the first considerations of 
a dissemination plan. What is it that will be dissemi- 
nated? This Is the core of the effort; it is the substance. 
Without it, theie can be no dissemination. The con- 
tent combined with purpose and audience provide a 
basis for systemic change. Exhibit 2 presents an 
example of purpose, audience, and content combined. 



Decision Point #4 Designing Shategies 



A common feeling in the creation 
of most dissemination plans 
Is to jump to ttie strategy 
before considering 
tt)e prior questions. 



"Purpose** (Decision Point #1) and "audience** (Deci- 
sion Point #2) are considered along with "content** 
(Decision Point #3) prior to determination of the 
strategy. Exhibit 2 provides an aid to guide this 
procedure and the previous example (Exhibit 1) 
illustrates how these elements are used to develop 
a strategy. 

There are many dissemination strategies that can and 
should be entertained. Many will be familiar and some 
are new. The following is an illustrative, but not 
exhaustive, list: 



• Formal report 

• Brochure 

• Lecture 

• Symposium 

• Personal Interview 

• Demonstration 

• Workshop 



Computer Conference • 
Electronic Mall • 
Video Conference • 
Telelecture • 
Film • 
Laser Disk • 
Exhibit • 



A common falling in the creation of most dissemina- 
tion plans is to jump to the strategy before considering 
the prior questions. A Principal Investigator may be 
taken with the idea of videoconferencing, for example, 
and select it as a primary approach without thinking 
through the match between this strategy and the 
purpose, audience, and content to be addressed. A 
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Exhlbn2 



An: Example of Purpose, Audience, and Content Combined 



Purpose? To develop guidelines ond 
examples for the teaching 
of laboratory science at a 
distance. 

Audience? Teachers of chenrustr/ who 
have taught or are inter- 
ested in teaching at a dis- 
tance. 

Content? The process of designing, 
developing, and evaluoting 
iTKrterials and techniques 
for teaching chemistry at a 
distance. 

Strategies? An invitational conference; 

demorutratior^; videotapes; 
electronic networks; reports 
ot professional rrieetings. 



Distance education is a significant trend in North Amerl- 
cansecondaryandpost-secondaryeducation.Theavail- 
obility of courses when schools or colleges cannot be 
reached because of location .time, or physical hondicap 
has been made possible through a variety of communi- 
cation technologies: computers, satellite video, tele- 
phones, and combinations of media. Most courses con 
be redesigned for distance learners by utilizing interactive 
learningtechniques. Hov\/ever,the laboratoryexperiences 
are an integral part of most beginning courses in chemis- 
try, biology and physics. When students and teachers ore 
remote from each other, it is difficult to provide opportu- 
nities for students to experience the discovery that is port 
of laboratory work. 

A proposal to NSF spelled out the need for a notional 
conference to exchange information among secondary 
and post-secondary teachers of chemistry who were 
involved in, or contemplated involvement in, teaching 
chemistry at a distance. This audience would bring mate- 
rials, experiments, and questions to a 3-daiy conference to 
exchange information with colleagues. A resource per- 
son from the British Open University, where successful 
chemistry laboratory programs hove been offered at a 
distance, would be available. The content cente'ed on 
materials, techniques, procedures, and student assess- 
ment used in teaching chemistry at a distance. 

To ensure further dissemination of the conference re- 
sults, individual participants would give brief demon- 
strations of their approoch and each would be 
videotaped for later use by individuals who hod not 
attended the conference. Further, during the confer- 
ence, the organizer would lead the group through a 
simulation exercise to create a laboratory kit for one 
topic in chemistry. The process would be documented 
and later turned into published guidelines for teachers 
of chemistry (and perhaps other laboratory sciences) 
to create laboratory kits for distance learners. Availabil- 
ity of the videotape and the guidelines would be 
announced Jn journals read by chemistry teachers. A 
presentation would be given at the notional confer- 
ence. Individuals attending the conference would be 
included on a notional computer network with bulletin 
board and electronic moil. 
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ASSESSING IMPACT 



related problem Is the over-reliance on a single strat- 
egy. For example, we may assume without really 
analyzing a situation that a written report is the best 
way to disseminate findings. This assumption is 
probably based in large part on the fact that our 
training has predisposed us to this alternative and we 
are most comfortable with it. It may not, however, be 
a strategy for success. 

Some examples help to Illustrate how various strate- 
gies can effectively combine media and procedures to 
"get the word out" to target audiences. 

We begin with the case of a research project that has 
come up with significant findings. Normally the re- 
secircher would seek publication in a refereed journal 
and a formal presentation at a conference of the field 
most closely related to the study. If a goal is limited to 
informing other researchers in the same specialized 
field about the findings, the normal strategies would 
apply. However, if the researcher is attempting to 
stimulate related research by other researchers, a 
symposium might be arranged, followed by an elec- 
tronic mail network for day-to-day sharing of informa- 
tion and new findings. 

Another example focuses on teaching and learning. A 
mathematics educator has developed and tested new 
approaches to teaching geometry using microcom- 
puters. His objective is to gain acceptance of the new 
approaches by secondary school mathematics teach- 
ers from urban schools. Presentations are planned for 
several national meetings that are usually attended by 
teachers from the defined audience (understanding). 
Summer workshops are announced for individuals 
who have expressed interest in the new procedures 
(adoption) and a computer network is used for follow- 
up and interaction among those who have adopted the 
new techniques and materials (implementation). 

Decision Point iS— Assessing Impact 

After all the planning, the question is: **Has the 
dissemination effort made any diiTerence?** Has there 
been any change In the people who were being ad- 
dressed? What has happened (if anything) as a result 
of dissemination? 

A first step in measuring **success** is to review the 
criteria upon which **success** will be determined. 
Start with the previously stated purpose — to what 
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An integral pari o1 any 
dissemination plan is evaiuation 
of tt)e result. 



Summary 



extent has this purpose been reached? How do you 
know? If you do not have evidence, how can it be 
obtained? To what extent are quantitative data helpful 
and when is qualitative information more useful? 

Too often we are willing to limit ourselves to making 
information available. An integral part of any dissemi- 
nation plan is the evaluation of the result Sometimes 
such information is not immediately available be- 
cause it takes time for new users to decide, to adopt, 
sind to gain resources to implement However, here are 
some examples of feedback that should be systemati- 
cally recorded: 

• Requests received for more information in writing 
or by telephone 

• Number of Individuals (or organizations) that 
sign-up for training offered by the Principal 
Investigator 

• Number of persons who visit sites where new 
practices are being used 

• Number of invitations for speakers/consultants 
to come to the site where the new practice is 
being considered. 



The guidelines presented above provide a general 
overview of dissemination as it applies to NSF projects. 
It is intended to assist Principal Investigators in the 
creation of a dissemination approach. To summarize 
these suggestions, an overview has been developed to 
provide tips for dissemination. 
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rips for Dissemination Planning 

1 . steps To Be Token Eorly in the Project 

A. Draft o globol dissemination plan, which includes: 

♦ The identification of primary and secondary audiences 

♦ Son^ indication of the objectives for these audiences: awareness, un- 
derstanding, adoption/adoption, implementation, or institutionalization 

♦ Some general ideas of the form of the dissemination for main audiences 
(monograph, seminar, working group) 

♦ A preliminary budget: likely time, finances, staff required for dissemina- 
tion effort. 

B. Contact key members of the main target audience(s) to: 

♦ Inform them about the study or project 

♦ Find the convergence between the study or project and their concerns and 
interests 

♦ Get a sense of their understanding or conceptual mastery of the prob- 
lerm nested in the research and development questions 

♦ (Eventually) "sign-up" one or more people who will follow the project 
and help with its dissemination. 

C. Have a look at the project design and analysis plan to see where: 

♦ Findings may be generalized to the target audiences 

♦ Certain findings can answer local questions 

♦ Outlines will not require too many ''translations" to be used by nonspe- 
cialists. 

2. Steps To Take During the Project 

♦ Create simple mechanisnrts (meetings, study day) allowing key users to 
gradually master the content and significance of the project. 

♦ Give these non-specialists some intermediary report in a readily under- 
standable form. If possible, do some of this transfer interactively. 

♦ Control the level of understanding of the project by those within the 
audience(s) who are likely to carry some of the results and products to 
their organizations. 
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♦ Try to identify the most pertinent inforrtKition and products for the Principal 
audience(s), and discuss with them the best channels of communication. 

3. Steps During the Concluding Phase of the Project 

A. Elaborate a precise dissemination plan for the principal "target" audiences: 

♦ Be specific about objectives (enlightenment, change of perspective, 
action). 

♦ Be specific about different channels meant to carry the products to Icey 
publics: reports, working group, training, articles in a professional joumal. 

♦ Be clear about time, personnel, resources required. 

♦ Create a realistic timetable. 

B. Woric out the responsibilities of l<ey people in the organization: 

♦ Negotiate a commitment on their port. 

♦ Make explicit the part of the dissemination that they will carry. 

♦ Make explicit the contribution that the project team will make. 

♦ Be explicit about the time, means, and people that will be available to 
individuals in these units who will be following up on the project. 

4. Steps During the Actual Conduct of the Dissemination: 

General message: structure these dissemination activities as ''conver- 
sations" with non-specialists about this project not as an •'instructionar 
event. 

"Nourish" regukarty the intermedkmes who are dtsseminating ttie project lo- 
cally. 

Discuss with users the components of the project that can be translated into 
specific recomrT^endations— that show what can be "done" with the find- 
ings or products in specific settings of use. 

Control the "readability" of documents, along with the level of under- 
standing of information presented interpersonclly. Give these tasks to 
members of the team who can best communicate with nonspecialists. 

Stay in touch, monitor the dissemination effort until staff, trainers, and 
key administrators have taken the study into internal councils (for deci- 
sions, planning) and have clearly mastered the project and its conse- 
quences. 



♦ 



♦ 



♦ 
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♦ Plan some of this contact time for informal social contacts; leave some 
"slack^ space in ttie program of dissemination. 

♦ Produce products with visuals, humor, attractiveness; do not overload 
with statistics and tables, detailed conceptual analyses, specialized lan- 
guage. Vary oral and written products; think of several ways to illustrate 
the main conclusions. 

♦ Focus on "alterable'' variables— on variables that can realistically be 
changed in desirable ways. 

♦ Be aware of local sensitivities, hierarchies, politics. They are very impor- 
tant; critical analysis is often received as personal criticism. 

♦ At several points, meet with key useis and intermediaries to see how the 
dissemination effort is progressing, and to determine what needs to be 
amended. 

♦ If you are interested, follow up on suggestions to pursue this project; be 
ready to address local questions that go beyond the information you 
have provided but are pertinent to it. 



If the awardee proposes to use grant funds for ttie purpose of commer- 
cial dissemination of any researcti results/products under the awardee's 
proposal, ttie awardee stiouldbe aware ttiat ttie requirements of Articles 
17 and 19 of GC- 1 will apply as well as any special terms or conditions 
set fortti in any award. 
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Glossary 



Adoption (adopter) 

Cttange agent 
Dissemination 

Gatekeeper 

Implementation 
Innovation (innovator) 

Institutionalization 
Strategy 



The "C'Sion to make full use of innovation as the best 
course of action available (the person or group who 
make decisions) (Rogers, 1983. p. 172). 

The person who introduces and usually facilitates the 
adoption and implementation of an innovation. 

The process of communicating information to specific 
audiences for the purpose of extending knowledge 
and. in some cases, with a view to modifying policies 
and practices. 

An individual or individuals who withhold or reshape 
information that they control as it flows into their 
system (Rogers. 1983. p. 354). 

Putting an idea, process or product into use. 

An idea, practice or object that is perceived as new by 
an Individual or other unit of adoption (the person who 
introduces or accepts the idea, practices or object) 
(Rogers. 1983. p. 11). 

Continued or routine use of an innovation after 
adoption and implementation. 

A systematic plan of action to reach predefined goals. 
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